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Summary 

Objectives: To determine the consistency between infor- 
mation contained in the registration and publication of ran- 
domised controlled trials (RCTs). 

Design: An observational study of RCTs published between 
May 201 1 and May 2012 in the British Medical Journal (BMJ) 
and the Journal of the American Medical Association (JAMA) 
comparing registry data with publication data. 
Participants and Settings: Data extracted from published 
RCTs in BMJ and JAMA. 

Main outcome measures: Timing of trial registration in 
relation to completion of trial data collection and publica- 
tion. Registered versus published primary and secondary 
outcomes, sample size. 

Results: We identified 40 RCTs in BMJ and 36 in JAMA. All 
36 JAMA trials and 39 (98%) BMJ trials were registered. 
All registered trials were registered prior to publication. 
Thirty-two (82%) BMJ trials recorded the date of data com- 
pletion; of these, in two trials the date of trial registration 
postdated the registered date of data completion. There 
were discrepancies between primary outcomes declared 
in the trial registry information and in the published paper 
in 18 (47%) BMJ papers and seven (19%) JAMA papers. The 
original sample size stated in the trial registration was 
achieved in 24 (60%) BMJ papers and 21 (58%) JAMA papers. 
Conclusions: Compulsory registration of RCTs is meaning- 
less if the content of registry information is not complete 
or if discrepancies between registration and publication are 
not reported. This study demonstrates that discrepancies 
in primary and secondary outcomes and sample size 
between trial registration and publication remain common- 
place, giving further strength to the World Health 
Organisation's argument for mandatory completion of a 
minimum number of compulsory fields. 
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Background 

Since 2004, clinical trial registration has been recom- 
mended, and reputable medical journals claim to 
insist on it. 1 However, in practice registration may 



be omitted, postdated, or information provided in 
the trial registration may not correlate with the even- 
tual trial publication. 'Publication bias' arises when 
the results of trials are not published because of the 
strength or direction of the results. 'Outcome report- 
ing bias' refers to the selection for publication of a 
subset of the originally chosen variables to be 
reported based on the results. 2 Both publication 
and outcome reporting bias threaten the validity of 
evidence-based medicine, and clinicians only have 
access to the results which the researcher chooses to 
publish. Strict, comprehensive registration of trials at 
their outset allows the differences between what was 
originally planned in the study and what is eventually 
published to be seen, allowing critical evaluation of 
the trial and minimising these two sources of bias. 

A Cochrane Review in 2011 found that discrepan- 
cies between trial registration and publication were 
common and often not declared in the publication. 2 
The 2010 CONSORT checklist, a guide to what to 
include when reporting clinical trials, includes 'Any 
changes to trial outcomes after the trial commenced, 
with reasons' which should provide further transpar- 
ency. In a comprehensive review of the historical con- 
text of biased reporting of clinical trials, Dickersin 
and Chalmers 3 conclude it is a 'serious and extensive 
problem, which threatens the best interests of 
patients, undermines the scientific enterprise and 
wastes resources'. Mathieu et al. in a survey of 
reviewers of clinical trial manuscripts found that 
only 34% had examined trial registry information 
in the process of peer review. We sought to compare 
trial registrations with trial publications from two 
reputable general medical journals to see if anything 
had changed. 

Methods 

We searched for randomised controlled trials (RCTs) 
published between May 2011 and May 2012 in the 
British Medical Journal (BMJ) and the Journal of the 
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American Medical Association (JAMA) using the 
journals' respective webpages. We assessed 
the abstracts of retrieved citations to determine if 
the study was randomised. We defined a randomised 
study as a comparative study in which there is 
random allocation of participants to an intervention 
and a control group, with follow-up to examine dif- 
ferences in outcomes between the two groups. 5 We 
excluded review articles, observational studies, 
meta-analyses and follow-up studies. 

We examined the corresponding trial registry 
information using the trial registration number in 
the published paper where it was available. Where a 
trial registration number was unavailable, we 
searched for trial registry information in the follow- 
ing clinical trial registries: International Standard 
Randomised Controlled Trial Number Register 
(ISRCTN), ClinicalTrials.gov (NCT) and the registry 
of the country of the first author of the paper. 

We collected data on whether the trial was regis- 
tered, date of trial registration and date of trial pub- 
lication, registered and published primary endpoints, 
registered and published sample sizes, registered and 
published statistical analysis plans and whether dis- 
crepancies were declared in the published paper. 

We read the full-text articles of all RCTs and com- 
pared trial registry information with information 
from the corresponding trial publication. Where 
available, we examined the archived trial registry 
data, looking for changes to the registration to see 
whether changes had been made to the registry post 
trial publication. 

Results 

We identified 40 RCTs in BMJ and 36 in JAMA. All 
36 JAMA trials and 39 (98%) BMJ trials were regis- 
tered, only one trial was unregistered. This was a trial 
of sildenafil citrate use for pulmonary arterial hyper- 
tension, and the paper reported on the ocular safety of 
the drug. In the publication arising from this trial, two 
different trial registrations numbers were reported but 
neither referred to an RCT where ocular safety was an 
outcome measure (primary or secondary). 

All 39 BMJ trials that were registered were regis- 
tered prior to publication. Thirty-two (82%) BMJ 
trials recorded the anticipated or actual date of out- 
come data completion. In 3 1 of those trials, the date 
of data completion proceeded the date of trial publi- 
cation by an average of 24 months (range 7-56 
months). One trial registered an anticipated date of 
data completion nine months post the date of trial 
publication. In two out of 32 trials, the date of trial 
registration postdated the registered date of data 
completion (by 5 and 6 months). Excluding these 



two trials, the average time between trial registration 
and date of data completion was 27 months (range 5- 
63 months). 

All 36 JAMA trials that were registered were regis- 
tered prior to publication. Thirty-three (92%) JAMA 
trials recorded the date of outcome data completion. 
Of those, in 31 trials the date of data collection pre- 
ceded the date of trial publication by an average of 21 
months. In two trials, the registered anticipated date of 
data completion postdated the date of trial publication 
(by 8 months and 47 months). All 31 trials were regis- 
tered before the date of data completion with an aver- 
age time of 46 months (range 3-142 months). 

There were discrepancies between primary out- 
comes declared in the trial registry information and 
in the published paper in 18 BMJ papers (47%) and 
seven JAMA papers (19%). The discrepancies are 
listed in Table 1. 

The original sample size stated in the trial registra- 
tion was achieved in 24 (60%) of BMJ papers and 21 
(58%) of JAMA papers. Of those RCTs where the 
sample size was not achieved, the sample size was 
underachieved by <10% in 7/11 studies in BMJ 
and 3/14 studies in JAMA (Table 2). Of those studies 
where the sample size was not achieved, this was 
openly disclosed in the trial publication in 4/16 
BMJ papers and 4/15 JAMA papers. 

We did not find evidence of a registered statistical 
analysis plan for any of the trials we included from 
BMJ and only one trial in JAMA provided details of 
their statistical analysis plan in the trial registration. 

Discussion 

Compulsory registration of RCTs is meaningless if the 
content of registry information is not complete or if 
discrepancies between registration and publication 
are not reported. This study demonstrates that while 
the majority of published RCTs in major journals are 
registered in a timely fashion, discrepancies in primary 
and secondary outcomes and sample size between trial 
registration and publication are commonplace, and 
often not mentioned in the published paper. 

Although the Cochrane Review included 16 stu- 
dies with a median number of 54 RCTs, many 
people believe there has been a recent improvement. 
Our study of 76 RCTs is larger than the average of 
the studies included in the Cochrane Review and 
more up to date. 

The papers from the two journals were examined 
by only one author (KW, BMJ; GS, JAMA). It 
would have added more scientific rigour if each 
paper had been examined separately by two authors. 

In a study of 110 RCTS published in 2009 com- 
paring trial registry information with trial 
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Table I . Discrepancies between registered and published primary outcomes. 



Registered and published primary outcomes 


BMJ (39) 


JAMA (36) 


No discrepancy between registered and published primary outcome 


21 (53%) 


29 (81%) 


No primary outcome registered 


2 (5%) 


1 (3%) 


Change in timing of the assessment of the primary outcome 


4 (10%) 


1 (3%) 


New primary outcome introduced in the paper 


7 (18%) 


3 (8%) 


Registered primary outcome not reported in the paper 


2 (5%) 


0 


Registered primary endpoint reported as secondary outcome in the paper 


1 (3%) 


1 (3%) 


Registered primary endpoint reported in a previous publication 


1 (3%) 


0 


Registered secondary outcome reported as a primary outcome in the paper 


1 (3%) 




Change in study population 


0 


1 (3%) 



Table 2. Discrepancies between registered and published 
sample size. 



Sample size 


BMJ (40) 


JAMA (36) 


Sample size achieved 


24 (60%) 


21 (58%) 


Sample size not achieved 


1 1 (28%) 


14 (39%) 


By >I0% 


4 


1 1 


By<IO% 7 3 


Sample size not registered 


2 (5%) 


0 


Registered SS changed 


3 (8%) 


1 (3%) 



publication, Ewart et al. 6 found that in 3 1 % of trials 
a primary outcome had been changed, and in 70% of 
trials a secondary outcome had been changed. 
Mathieu et al. 7 in a similar paper published in 2009 
examining 147 studies found a discrepancy in primary 
outcome between registration and publication in 3 1 % 
of studies. We found discrepancies in the primary 
outcome in 33% of trials. Ewart et al. 6 clearly state 
that they examined trial registry data as it appeared 
on the day of examination of the registry but did not 
examine changes to trial registration in the archive. 
We did examine archived trial registry information 
looking for changes that may have resulted in a 
greater number of discrepancies being uncovered 
and why there has been no improvement in discre- 
pancies since the publication of the Cochrane 
Review. Hannink et al. 8 in a study of 327 surgical 



RCTs found that only 152 trials were registered 
before the end of the trial. Of those 152 trials, 75 
(49%) showed evidence of a discrepancy between 
registered and published outcomes. And in 28% of 
the trials, these discrepancies favoured statistically 
significant results. Ross et al. 10 scrutinised the com- 
pleteness of trial registry information in 
ClinicalTrials.gov and found that while compulsory 
data sets were completed nearly 100% of the time, 
when it came to optional data sets reporting was 
varied: principal investigator name (63%), enrolment 
(82%), start date (87%), end date (53%), primary 
outcome measure (66%) and secondary outcome 
measure (56%). Huic et al. 9 in a study of 149 RCTs 
found that 77.6% of RCTs had a different sample 
size recorded in the registration data than in the pub- 
lished data. 9 

This paper gives further strength to the argument 
that the World Health Organisation Minimal 
Registration Data set should be adopted by trial 
registries and journals so that compulsory fields are 
completed when a trial is registered (WHO Trial 
Registration Data Set Version 1.2.1). Reveiz et al. 11 
make the argument that making trial protocols pub- 
licly available would expose the full methodological 
detail of trials and improve the ability of journals to 
critically appraise the reporting of trials. 

It is well established that clinical trials reporting 
positive outcomes are more likely to be published 
than those that feature negative results. But the inclu- 
sion of positive outcomes can also influence the speed 
of publication and the accessibility of the work. 3 

It would be interesting to know whether there is a 
similar correlation between trials with discrepancies 
in primary and secondary outcomes from registration 
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to publication and an increased likelihood of report- 
ing positive outcomes than trials that stick to their 
registered intentions. 

Conclusion 

It is clear that compulsory registration without scru- 
tiny of the registration contents leads to widespread 
discrepancies in the trial registration and eventual 
trial publication. Registration should be a more strin- 
gent exercise, where certain fields are compulsory. 
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